Fourier neural networks as function approximators and differential equation solvers
نویسندگان
چکیده
We present a Fourier neural network (FNN) that can be mapped directly to the decomposition. The choice of activation and loss function yields results replicate series expansion closely while preserving straightforward architecture with single hidden layer. simplicity this facilitates integration any other higher-complexity networks, at data pre- or postprocessing stage. validate FNN on naturally periodic smooth functions piecewise continuous functions. showcase use for modeling solving partial differential equations boundary conditions. main advantages current approach are validity solution outside training region, interpretability trained model, use.
منابع مشابه
Fuzzy Neural Networks as “Good” Function Approximators
The paper discusses the generalization capability of two hidden layer neural networks based on various fuzzy operators introduced earlier by the authors as Fuzzy Flip-Flop based Neural Networks (FNNs), in comparison with standard networks tansig function based, MATLAB Neural Network Toolbox in the frame of a simple function approximation problem. Various fuzzy neurons, one of them based on new ...
متن کاملArtificial neural networks as approximators of stochastic processes
Artificial Neural Networks (ANNs) must be able to learn by experience from environment. This property can be considered as being closely related to the approximating capabilities of the networks. Unfortunately at present only the ability of ANNs in approximating deterministic input-output mappings has been exploited. In this article it has been shown that some classes of neural networks, named ...
متن کاملNearest Neighbour Radial Basis Function Solvers for Deep Neural Networks
We present a radial basis function solver for convolutional neural networks that can be directly applied to both distance metric learning and classification problems. Our method treats all training features from a deep neural network as radial basis function centres and computes loss by summing the influence of a feature’s nearby centres in the embedding space. Having a radial basis function ce...
متن کاملFourier neural networks
A new kind of neuron model that has a Fourier-like IN/OUT function is introduced. The model is discussed in a general theoretical framework and some completeness theorems are presented. Current experimental results show that the new model outperforms by a large margin both in representational power and convergence speed the classical mathematical model of neuron based on weighted sum of inputs ...
متن کاملNeural networks with a continuous squashing function in the output are universal approximators
In 1989 Hornik as well as Funahashi established that multilayer feedforward networks without the squashing function in the output layer are universal approximators. This result has been often used improperly because it has been applied to multilayer feedforward networks with the squashing function in the output layer. In this paper, we will prove that also this kind of neural networks are unive...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Statistical Analysis and Data Mining
سال: 2021
ISSN: ['1932-1864', '1932-1872']
DOI: https://doi.org/10.1002/sam.11531